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Abstract. We consider a simple random walk {Wi} on Z"*, d = 1,2, in which the 
walker may choose to stand still for a limited time. The time horizon is n, the maximum 
consecutive time steps which can be spent standing still is m„ and the goal is to maximize 
P{W„ = 0). We show that for d = 1, if m„ ^ (logn)^^^ for some 7 > 0, there is a 
strategy for each n yielding P{Wn = 0) — )■ 1. For d = 2, if m„ 3> for some e > then 
there are strategies yielding liminf„P(W„ = 0) > 0. 

1. Introduction. 

We consider a process {Wj,0 < i < n} on Z'^ (d = 1 or 2) in which Wq = and each 
step Wi — Wi-i either is (i.e. standing still) or is a step icj of symmetric simple random 
walk (SSRW), with being the ith unit coordinate vector. The choice between standing 
still and SSRW step is determined by a strategy. Formally, a strategy (or n-strategy) is a 
mapping 5n ■ Tn ^ {0, 1} defined on the space 

"Tn = {{{h 'Wi),0 < i < j} : < j < n — l,\wi — Wi-i\ < 1 for all i| 

of all space-time trajectories of length less than n; here the values and 1 for 5n correspond 
to standing still and taking a SSRW step, respectively. Thus the choice of whether to take 
a step at a time i depends on the trajectory up to time i — Letting {Yi,i > 1} be SSRW, 
we then construct the controlled random walk process iteratively from the strategy by 

Wo = 0, W^-Wi.l = A,{Y,-Yi,^i) i<n, 

where 

Ai = 5n( {{k,Wk) : < k < i - 1} 



We define the time since the last SSRW step to be 

J, = mm{j G [0,i - 1] : Wi^j / W^i-j-i}, 

with Jj = i if the set in this definition is empty. We designate a maximum number m„ — 1 
of consecutive steps standing still and say that a strategy is admissible if Jj < m„ — 1 
a.s. for all i < n. A strategy is Markov if the value of 6n{{{k,Wk) : < k < i — 1}) 
depends only on the pair (Wi,Ji). It is easily seen that if the strategy is Markov, then 
{(IVj, Jj) : z > 0} is a Markov process. We write An for the set of all admissible strategies 
and An for the set of all admissible Markov strategies. When the dependence on the 
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strategy needs to be made clear, we write P{-;5n) for probability when strategy 5n is 
used, but generally we suppress the 6n in the notation. 

We are interested in steering the process toward a target site, and specifically in the 
behavior of 

(1.1) P{Wn = 0) = sup P{Wn = 0; 5n) 

as n — )• oo. The word "steering" is a bit misleading here, as the process never has a drift. 
For SSRW, of course P{Wn = 0) ~ Cn~°'/^. (Here and throughout the paper, C and 
Ci, C2, . . . are generic constants, and a„ ~ 6„ means the ratio converges to 1.) A simple 
strategy to increase this is to minimize steps, i.e. always stand still as long as allowed, 
taking only n/nin steps, yielding P{Wn = 0) x {mn/nY/'^ , where we use an x bn to 
mean the ratio is bounded away from and 00. A slightly more sophisticated strategy 
is to minimize steps until time n — nin then maximize steps (i.e. never stand still) until 

{Wi} hits (if it does), and then stand still until time n. For d = 1, conditionally on 

1/2 

{|W„_m„| < run } this strategy has a success probability of order 1, so the unconditional 
success probability is of order min(m„/n^/^, 1); in particular it is bounded away from if 
rrin > Cn^l'^ . 

This brings up two questions. For which {m„} is P{Wn = 0) bounded away from 0? 
And are there nontrivial {m„} for which P{Wn = 0) — t- 1? Our two main theorems give 
some answers. 

Theorem 1.1. Suppose d = 1 and rrin 3> (logn)^^'^ for some 7 > 0.. Then P(Wn = 
0) — >■ 1 as n —)• 00. 

In one dimension, the "more sophisticated" strategy described above relies on the fact 
that a SSRW started at distance k from has a probability of order one to hit by time 
k^. In two dimensions, this probability is only of order (logA;)"^ so it is more difficult to 
construct a strategy based on waiting for the RW to return to after it has wandered 
away. Nonetheless we have the following. 

Theorem 1.2. Suppose d = 2 and rUn ^ for some e > 0. Then 

liminf P(W„ = 0) > 0. 

n 

In (II. ip one could consider only Markov strategies, i.e. take the sup over A^- Since the 
underlying SSRW is Markov, one cannot actually do better with a non-Markov strategy, 
so the two sups are the same. Allowing non-Markov strategies simply lets us use ones that 
can be concisely described and analyzed. 

Remark 1.3. One could consider alternate ways of slowing down the controlled RW, in 
place of standing still. For example, one could allow a choice between a standard SSRW 
step and a delayed SSRW step, the latter meaning we stand still with probability 1 — 
and take a standard SSRW step of itej with probability l/m„, with no limit on how many 
consecutive times we choose the delayed SSRW step. A brief examination of the proofs 
shows that both theorem statements above remain valid in this case. 

Remark 1.4. The continuous analog of the problem we consider is a diffusion in which 
the drift is always and one can control the diffusivity a{x,t), but constrained to an 
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interval [cri,(72], on a time interval [0, T], where ai > 0. We take [cti,(T2] = [cti 1] and 
ask, how slowly can we have e-r — as T — )• oo and still have -P(|Ct| < 1) — ^ 1 or 
liminfr Pdc^-rl < 1) > 0? Note that er is the analog of l/m-„. McNamara [3j considered 
closely related questions for a one-dimensional diffusion; see also [2] for another variant. 
He proved that there are constants K = K{ai,a2) and /3 = /3{ai/a2) such that 

(1.2) ("i^tI < < ^ f-iV for all X G M, > 0, 



while in the other direction, for each h > there exists A > such that 



6\ .J b 



(1.3) ( \iT\ < I 1 > K ( ) for all b G (0, A). 



Here denotes probability (maximized over the allowed controls) for a process started 
at X. Numerical evidence was given that /3 is approximately proportional to 0"i/c72. If we 
assume this to be true and consider of order 1/ log T, we get /3 of order 1/ log T as well. 
If we could take h also of this order, then the right side of (jl.3p would be bounded away 
from in T, as desired. The problem is that one cannot get a useful result from (jl.3p if 
one takes h depending on T, since then b must also depend on T . Nonetheless we may 
observe that < C/logT corresponds to m„ > Clogn in our discrete problem. Further, 
still assuming /3 proportional to (Ti/cr2, we see that since we want the left side of (II. 2p 
bounded away from 0, we cannot allow ^ 1/logT, suggesting that we perhaps cannot 
do better than requiring m„ > C log n in Theorem 11.11 



2. Proof of Theorem 11.11 

Throughout the paper we will make use of various quantities which approach infinity 
as n — >• oo. For A > let Mn(A) = maxj/c : m}^^^ < n}; note that Un{\) is of order 
logn/logm„ for all A > 0. Also, the hypothesis that m„ ^ (logn)^"'"''' for some 7 > is 
equivalent to 

/(logn)2\^/(^~") 
(2.1) mn > ^ ^ for some rj G (0, 1). 

\ log log n J 

Fixing such an r] and writing Un for Un^rj), we observe that (|2.ip is equivalent to 

mlj^^lognin » (logn)^, 

hence also to 



and therefore finally to 

(2.2) Un = 

Fix n, write m for m„. and define 

log m 



l-ri 

log nin 



1/2N 



, so em = oi^\ asn^oo. 
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We define a sequence of windows {tk} x 7^, 1 < A; < u„, in space-time, with size decreasing 
as k increases and the target (n, 0) is approached; we then construct a strategy which 
makes the space-time trajectory of the process pass through ah of these windows, with 
high probabihty. Specificahy, let 

= n - m^+''(""-^\ 2<k<Un, and to = 0, *i = tu„+i = n, 

Nk = tk — tk-l, hmk = (emNk+l)^^'^ ■ 

Let lo = {0}, 

h = [-hmk, hmk], l<k<Un, and = {0}. 

We want to find a strategy, and choice of em, for which we can show 

(2.3) Tuay: P{Wt^iIk\Wt^_^eIk-i) = o[ — \ as n ^ oo. 



From ((22]) and ((OD it follows that 

(2.4) P{Wn = 0) > n e I ^ ^fc-i) -[}-''[—)) 

k=l ^ V^n// 

as n — )• oo, proving the theorem. 

For ([23]), fix 1 < A; < n„ -Fl and let tq = rj^"^ = mm{t > tk-i : Wt = 0}. Fix x £ h-i 
and observe that 

P{Wt, i h I Wt,_, = x) < P (to > = x) 

(2.5) + P (to < tfc, imj > hmk\Wt^_, = x) . 

To fully specify, and then bound, these probabilities we need to designate a strategy; we 
do so by describing how the strategy works between t^^i and t^, for general k. For k < Un, 
we begin by taking all SSRW steps (i.e. no standing still) from time until time To At^. 
If Tq > tk, we deem the strategy to have failed and we continue in an arbitrary manner, 
say all SSRW steps. If To < tfc) we continue from time tq to tk by always standing still 
for the maximum allowed period of time m during the interval (to,^^], that is, we take 
an SSRW step every mth time step. The last standing period is truncated if it would 
otherwise go beyond time tk- 

For k = Un + I, our strategy during {tu„,tu„+i\ = {n — m, n] is to maximize steps until 
the the time tq = 7-^"""^^) when the process first hits (if tq < n), then stand still until 
time n. 

We now bound the first term on the right side of ()2.5p . From the Reflection Principle 
we have (for £, hmk of opposite even-odd parity): 

(2.6) Pi4^'> - tk-i > I I Wt,_, =x) = P{-\x\ <Yi< \x\), 
and hence for every e > 0, 



pi4'^ - tk-i > yx' I wt,_, = x)^2^^i^—]- m 

(2.7) as — )• 00, uniformly over y £ [e,oo). 
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The left side of (12 .Gh is a nondecreasing function of \x\, so for all x £ Ik, hy p.7p 
(2.8) P {to > tk I Wt,_, =x) <P{to- tk-i > Nk I Wt,_, = h^k) < C^. 



Turning to the second term on the right side of (j2.5p , it is for /c = ti„ + 1 so we consider 
k < Un- We can condition also on tq as follows: for t £ (tfc_i,tfc], using Hoeffding's 
Inequality [Ij, 

P {\Wt,\ > K,k I TO = t, Wt,_, =X)=P {\Wt,\ > hrak | ^ = O) 
(^2.9) — ^-me,nNk+i/2Nk ^ 

For k > 1 we have N^+i/Nk > (with equality for A; > 3), so ()2.9p says that 

(2.10) P {\WtJ > hmk I TO = t,Wt^_^ =x)< < 

Since x S Ik-i is arbitrary, combining (j2.5p . (j2.8p and (j2.10p yields that for all 1 < A; < 

(2.11) p{Wt,ih\Wt,_,£lk-i)<C^ = o(—\ asn^oo, 
proving (j2.3p and thereby proving Theorem ll.il 

3. Proof of Theorem 11.21 

We keep the same definition of Un{X) and note that now our hypothesis on m„ is 
equivalent to the statement that is bounded, say u„, < n < oo for all n. We keep the 
same formula for but with r] replaced by k, determined as follows. Choose 

1-e 1 
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so 1 — 20 < e, then choose k small enough so 
/X 1-20 

We then write n„ for Un{K). For our windows, in place of the interval we have the 

square Qk = [— ^f+u -^f+i]^- To distinguish dimensions clearly, we now write {Y^"^^} for 
d-dimensional SSRW, d = 1,2. We use the same strategy as in one dimension: in each 
interval {tk-i,tk], take an SSRW step every time step until time Tq'\ then an SSRW step 

every mth time step from time Tq to tk- In place of (12. 3p . we will need that for some 
C>0, 



(3.2) 



PiWt, G Qk I Wt,_, G Qk-i) > C for aU k, for all large n. 
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Let ft] be the number of visits to by the SSRW {Y-^ } during the time interval [a, h]. 
In comparison to (|2.8p . we have for ah x S Qk-i'- 

P (to < tk I Wt,_, = x) = P (ro < tfc I yI^I^ = x) 



Since |x| < CN^ with 6* < ^, the numerator in (j3.3|) is equal to 

(3.4) ^(^* = I 1^0^'^ = x) > C ^ - > Ci log A^fc. 

i=l i=|a;p 

Here Ci depends on 0. The denominator in (|3.3|) is bounded above by 

(3.5) ^(^(t.-iA] I ^J'^ = 0) < C ^ < CalogiVfe. 
Therefore we have the analog of (|2.8p : 

(3.6) P (to < tfc I Wt, 1 = x) > > for all k<Un,xe Qk-i- 

In comparison to (j2.9p . we have for x £ Qk and t G (tA:-i,ifc], using again Hoeffding's 
Inequality [T|: 

(VFi, ^ Qfc I TO = =x)=P {Wt, (^Qk\Wt = 0) 

= p ^ Qfc I = 



<2 niax P(|y«| >iVf+i) 

j<Nk/m 

(3.7) < 4e-'^^f+i/2^fe. 

For /c > 1 we have Nk+i > m~'^Nk (with equality for A; > 3), so by ()3.ip . 

rni-^'^^ ^1-2.^ 

(3.8) — — — > — > — ;> oo as n oo. 

Combining p.6p . (13. 7p and (13. 8p we see that ()3.2p holds. Since {un} is bounded, it follows 
as in (1231) that liminf„ P{Wn = 0) > 0. 
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